home *** CD-ROM | disk | FTP | other *** search
/ Chip: 2005 Utilities / CHIP Utilities 2005.7z / CHIP Utilities 2005.iso / docs / freedos / support.intel.com / robots.txt
Encoding:
Text File  |  2001-03-15  |  458 b   |  21 lines
  1. # robots.txt exclusion for www.intel.com
  2. #
  3.  
  4. # for all agents, keep them out of the /cgi directory
  5.  
  6. User-agent: *
  7. Disallow: /cgi
  8. Disallow: /iaweb/
  9. Disallow: /cpc/vision/
  10. Disallow: /intel/june297/
  11. Disallow: /cpc/eps/
  12. Disallow: /design/june297/
  13. Disallow: /cpc/archive/
  14. Disallow: /cpc/dia/
  15. Disallow: /cpc/ecs/
  16. Disallow: /cpc/fcs/
  17. Disallow: /cpc/gif/
  18. Disallow: /cpc/OptContent/
  19. Disallow: /cpc/pix/
  20. Disallow: /cpc/sound/
  21. Disallow: /cpc/feature/